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IN THE CLAIMS: 

The text of all pending claims, (including withdrawn claims) is set forth below. Cancelled 
and not entered claims are indicated with claim number and status only. The claims as listed 
below show added text with underlining and deleted text with str i koth rough . The status of each 
claim is indicated with one of (original), (currently amended), (cancelled), (withdrawn), (new), 
(previously presented), or (not entered). 

Please AMEND claims in accordance with the following: 

1 . (currently amended) A computer-based system in communication with a plurality 
of different types of computing sources of functionality, each computing source of functionality 
being a service to a user, comprising: 

means for associating each service with a semantic service description (SSD), which 
semantically describes the plurality of different types of computing sources of functionality for 
filtering, composing and executing the service, and is discoverable as an available service 
according to one or more discovery protocols, wherein the SSD comprises: 

a semantic description of the service, including a semantic description of 
input/output parameters of the service as semantic input/output parameters, based upon an 
ontology, 

a filter parameter specifying relevance of the service, and 
a grounding including: 

a service invocation interface to the service; and/or 
an input/output parameter mapping and/or an input/output parameter 
transformation function between the semantic input/output parameters and syntactic input/output 
interface parameters of the service; 

means for dynamically discovering one or more of the SSDs as the available services 
through the p l ura li ty of one or more discovery protocols to discover the SSDs; 

means for real-time composing by a user a na composed executable task compr i s i ng 
comb i n i nq that is a combination of two or more of the available services by dynamically 
presenting to the user feasible possible executable tasks based upon ono or moro of filtering the 
discovered services according to one or more of a context of the user i nc l ud i nq and/or the 
composed executable task, the filter parameters in the SSDs, and/or the semantic input/output 
parameters in the SSDs; and 



2 



Serial No. 10/733,328 

means for executing a task by invoking the two or more available services that comprise 
the task, including enabling the user to interact with an invoked available service, based upon 
the grounding in the associated SSDs including the service invocation interfaces and and/or the 
input/output mapping and/or the transformation functions between the semantic input/output 
parameters and the syntactic input/output parameters. 

2. (previously presented) The computer-based system of claim 1 , wherein the 
computing sources of functionality originate in devices, computing applications, electronic 
services and/or previously defined tasks. 

3. (previously presented) The computer-based system of claim 1 , wherein the SSD 
is expressed in a service description language. 

4. (previously presented) The computer-based system of claim 1 , wherein 

each SSD is provided by any combination of a creator or owner of the computing source 
of functionality or some other third party and 

the system further comprises means for making available or unavailable a service by 
making available or unavailable discovery of one or more of SSDs associated with the service. 

5. (cancelled) 

6. (currently amended) The computer-based system of claim 1 further comprising 
means for saving composed executable tasks automatically, or as instructed by the user, as new 
available services. 

7. (currently amended) The computer-based system of claim 6, wherein the 
pr e v i ous l y sp e c i f ie d composed executable tasks saved as services are available to the user who 
created them, to all other users, or to any user-defined, or pre-defined group of users. 

8. (previously presented) The computer-based system of claim 1 , wherein the one 
or more discovery protocols include one or any combination of the following: UPnP, UDDI, Local 
Service Repository, Jini, Bluetooth SDP, Rendezvous, and InfraRed (IR). 
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9. (previously presented) The computer-based system of claim 1 , wherein the 
filtering of the discovered available services according to the context of the user include any one 
or any combination of the following: 

User profile, Task at hand, User device characteristics, User location, User motion status, 
User network connectivity, User specified keywords, features of a set of the available services 
when considered as a whole, individual available service features. 

1 0. (previously presented) The computer-based system of claim 1 , wherein the real- 
time composing by the user of the executable task includes any one or any combination of the 
following: 

a planning-based, automated system, or 

an interactive user interface that supports any one or any combination of the following 
elements: visual, voice, text, Braille, tactile. 

1 1 . (previously presented) The computer-based system of claim 1 , wherein the SSD 
service invocation interface is according to one or more of a remote procedure call including 
Web Services, SOAP, UPnP actions, JINI, CORBA, RMI, RPC, DCE, DCOM, KQML, FIPA-ACL, 
or InfraRed (IR), or local function call, or local object call, or code described directly in the SSD. 

1 2. (previously presented) The computer-based system of claim 1 , further 
comprising means for managing a computing source of functionality as an available service 
through the associated SSD by any one or any combination of the following: a graphical user 
interface controlling creation, provision, holding, and/or removal of the associated SSD, 
executing or interacting with the computing source of functionality, or processing events from an 
operating system of a user-operated device and applications executing on the user-operated 
device. 

1 3. (previously presented) The computer-based system of claim 1 , wherein the 
means includes: 

a module to publish the SSD as the available service by making the SSD discoverable 
through one of the plurality of discovery protocols; 

a module to discover the SSDs as the available services as a Service Discoverer; 
a module to filter the SSDs as filtered available services as a Service Filter; 
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a module to automatically specify a task of two or more available services or to assist the 
user in specifying the task of two or more available services to comprise the task, as a Task 
Specifier; 

a module to assist the user with executing the task by invoking the available services that 
comprise the task, including enabling the user to interact with an invoked service as the 
available services are executed, as a Task Executer, and 

a User Interface to the Service Discoverer, the Service Filter, the Task Specifier, and the 
Task Executer. 

14. (previously presented) The computer-based system of claim 13, further 
comprising a single computing device or a distributed networked computer system, wherein the 
modules execute on the single computing device, or wherein the modules, or subcomponents of 
the modules, execute as distributed across multiple networked computing devices in the 
distributed networked computer system, and the modules are accessible by programmatic 
interfaces accessible to the User Interface invoked at a relevant computing device operated by 
the user. 

1 5. (previously presented) The computer-based system of claim 1 3, wherein the 
User Interface enables an executable workflow composition of the task according to a sequence 
of invoking the Service Discovery, followed by the Service Filter, followed by the Task Specifier, 
followed by the Task Executer, or any combinations thereof. 

16-18. (cancelled) 

19. (previously presented) The computer-based system of claim 15, wherein the 
User Interface is graphical and comprises any combination of: 

a Discovery Pane for displaying selectable discovered and filtered services; 

a Details Pane for displaying additional information of a selected service from the 
Discovery Pane; 

a Composition Pane for displaying listings of compatible services, according to the 
filtering, from the Discovery Pane; 

a Construction Pane for interactively specifying a workflow composition of selected 
compatible services as the task; 
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an Information Pane for displaying status information; 
a Save Pane for saving a composition of services; 

wherein the User Interface displays all or a subset of the panes simultaneously to the 
user, and 

wherein the User Interface real-time updates information in each pane according to a 
result of an action in another pane. 

20. (previously presented) The computer-based system of claim 19, wherein the 
User Interface enables navigating to the Construction pane by either selecting a service from the 
Discovery Pane and selecting a displayed construct function, or by selecting a pair of compatible 
services and selecting the displayed construct function. 

21 . (currently amended) The computer-based system of claim 19, wherein the User 
Interface enables adding and/or removing services from a currently composed executable task 
in the Construction Pane by choosing a plus or minus function for each possible workflow 
position that an insertion or deletion is possible, according to the discovering and the filtering. 

22. (previously presented) The computer-based system of claim 1 9, wherein the 
User Interface enables the user to execute a specified task by choosing an execution function 
when the task becomes executable, as automatically determined according to the executing, 
while either at the Construction Pane or the Composition pane. 

23. (previously presented) The computer-based system of claim 19, wherein the 
executing further comprises automatically completing a composition of services as a task by 
appending any, pre-defined or user-defined, compatible composition of available services before 
or after a partially specified composition of services by the user, and executing the complete 
composition in response to a user input. 

24. (previously presented) The computer-based system of claim 19, wherein a saved 
composition of services as the task is extendable with other available discovered and filtered 
services. 

25. (previously presented) The computer-based system of claim 13, wherein the 



6 



Serial No. 10/733,328 



User Interface is graphical and comprises selectable tab window panes including any 
combination of: 

a Discovery Pane for displaying selectable discovered and filtered services; 
a Details Pane for displaying additional information of a selected service from the 
Discovery Pane; 

a Composition Pane for Displaying listings of compatible services, according to the 
filtering, from the Discovery Pane; 

a Construction Pane for interactively specifying a workflow composition of services as the 

task; 

an Information Pane for displaying status information; and 
a Save Pane for saving a composition of services, 

wherein the User Interface visibly displays at any given time only one of window pane 
tabs to the user, and 

wherein the User Interface real-time updates information in each pane according to a 
result of an action in another pane 

26-30. (cancelled) 

31 . (previously presented) The computer-based system of claim 1 5, wherein the 
User Interface is graphical and comprises a first window pane to display discovered and filtered 
services, a second window pane to display a current task composition by the user, controls to 
navigate a displayed history of the task composition, and a control execute the task composition. 

32. (previously presented) The computer-based system of claim 31 , wherein the 
User Interface automatically places a selected service to a proper place in the workflow 
composition of the task. 

33. (previously presented) The computer-based system of claim 32, wherein the 
User Interface automatically completes the task composition upon an available filtered 
compatible service. 

34. (previously presented) The computer-based system of claim 15, wherein the 
User Interface is a web client. 



7 



Serial No. 10/733,328 



35. (previously presented) The computer-based system of claim 34, wherein the web 
client comprise a browser to pop-up a new window or re-direct the browser to a new link 
enabling the user to enter information related to the Task Execution or enter feedback regarding 
the executed task. 

36. (previously presented) The computer-based system of claim 15, wherein the 
User Interface is a command line interface, wherein each time the user types text compatible 
with a discovered and/or a filtered service, the User Interface inserts in the workflow composition 
of the task the compatible service or, if multiple compatible services exist the User Interface 
provides a selectable listing thereof. 

37. (previously presented) The computer-based system of claim 36, wherein a 
displayed sequence of user selected services corresponds to the task, and a signle user input 
executes the task. 

38. (previously presented) The computer-based system of claim 13, wherein the 
Service Discovery, the Service Filter, the Task Specifier, the Task Executer, and the User 
Interface execute on same computing device. 

39. (previously presented) The computer-based system of claim 13, wherein the 
Task Specifier comprises an Inference Engine presenting to the user the feasible possible 
executable tasks by identifying all possible pair wise combinations of the available services for 
an executable workflow composition of the task. 

40. (previously presented) The computer-based system of claim 38, wherein the 
Task Specifier comprises an Inference Engine presenting to the user the feasible possible 
executable tasks by identifying all possible compositions of the available services as possible 
executable tasks. 



41 . (previously presented) The computer-based system according to any one of 
claims 39 and 40, wherein the Inference Engine returns a number of the possible pair-wise 
combinations of the available services or executable task compositions according to criteria that 
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include an upper bound on computational resources, an upper bound on computing time, a 
number of the available services in a composition, or by a pre-determined total number of the 
possible pair-wise combination of services or task compositions to be computed. 

42. (previously presented) The computer-based system of claim 41 , wherein the 
Inference Engine includes a rule, or a set of rules, or a set of logic statements, as a task 
composition logic. 

43. (previously presented) The computer-based system of claim 13, further 
comprising one or more local and/or remote databases to store one or more SSDs, wherein the 
Service Discoverer uses a local SSD database or accesses a remote SSD to retrieve a 
corresponding associated SSD of a source of functionality presenting a service, according to an 
identifier (ID) specific to a discovery mechanism used to discover the source of functionality 
presenting the service. 

44. (previously presented) The computer-based system of claim 43, wherein one of 
the plurality of the discovery mechanisms is UPnP and the ID is Unique Device Name (UDN) of 
UPnP. 

45. (previously presented) The computer-based system of claim 38, wherein one of 
the discovery mechanisms is UPnP discovery. 

46. (previously presented) The computer-based system of claim 14, wherein the 
User Interface executes on a computing device different than computing devices executing the 
Service Discoverer, the Service Filter, the Service Specifier, or the Task Executer. 

47. (previously presented) The computer-based system of claim 46, wherein the 
User Interface is a web client (browser) that communicates by HTTP with the Service 
Discoverer, the Service Filter, the Task Specifier, or the Task Executer. 

48. (previously presented) The computer-based system of claim 46, wherein the 
User Interface is an application that executes on a user computing device and communicates by 
an application programming interface with Service Discoverer, the Service Filter, the Task 
Specifier, or the Task Executer. 
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49. (previously presented) The computer-based system of claim 14, wherein the 
single computing device is any of a desktop, laptop, pen computer, PDA or a mobile phone. 

50. (previously presented) The computer-based system of claim 13, wherein a 
service may have one or more interfaces for the user to interact with the service prior and during 
execution of the service. 

51 . (previously presented) The computer-based system of claim 13, wherein the one 
or more SSDs as the available services comprise any one of: 

"View on Display" to view a user-specified document on a display and optionally control 
how the document is displayed; 

"View on Multiple Displays" to view a user-specified document on more than one display 
and optionally control how the document is displayed; 

"Map Viewer" to view a map of a user-specified location and optionally control how the 
map is displayed; 

"Map Router" to view a map or textual description of a route from/to a user-specified 
location from/to a predefined or by a user-specified location optionally control how the map or 
textual description is displayed; 

"Instance Providing Service" to provide a semantic instance of a class described in an 
ontology; 

"Print" to print a user-specified document or a semantic instance in a specific format on 
a printer in a pre-defined way or optionally control how the document or the semantic instance is 
printed; 

"Fax" to send a fax of a user-specified document to a user-specified fax number and 
optionally control how the document is faxed; 

"Play Video" to play a user-specified video content and optionally control how the video is 

played; 

"Play Audio" to play a user-specified audio content and optionally control how the audio is 

played; 

"Digital Photo Frame" to display a user-specified image content and optionally control 
how the image is displayed; 

"Location Determination" to automatically determine a location of a user-operated device; 
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"Directory Publisher" to choose one instance out of a set of instances of the same type; 
"Telephone Dialer" to dial a user-specified phone number; 
"Storage" to store or retrieve files; 

"Copy to Removable Storage" to store one or a set of files into predefined removable 
storage media and optionally control how the files are saved; 

"Emailer" to send email to a user-specified email address optionally with attached user- 
specified documents and optionally control how the email is sent; 

"List chooser" to choose an semantic instance from a list of semantic instances of the 
same type; 

"Property chooser" to choose one of properties from a semantic instance; 

"Your input" to input values for attributes of a semantic object; 

"Instance viewer" to check and modify a semantic instance; 

"Local Instance Selector" to select one or more local semantic instances ; 

"Semantic Instance Copier" to copy a semantic instance; 

"L-Note" to read and leave notes pertinent to a location; 

"Database publisher" to publish a whole of or a part of a table from a database; 

"Place information" to provide information related to a place; and 

"Hosted Services" to use a browser to execute functions, including "Upload File" to let 
the user to upload a file, "URL to input" to let the user to input an URL, and "View on Browser" to 
let the user view a file . 

52. (previously presented) The computer-based system of claim 12, wherein the 
graphical user interface for managing the computing source of functionality as an available 
service through the associated SSD includes any one or combination of the following: 

means for making the SSD available through one or more of the discovery mechanisms, 
means for changing the SSD discovery mechanism to use, 
means for holding the SSD, 

means for recovering the SSD to one of the discovery mechanisms, 
means for removing the SSD from discovery mechanisms, and 

means for changing the SSD publishing parameters including expiration, invocation limit, 
and access control. 

53. (previously presented) The computer-based system of claim 52, wherein the 
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graphical user interface comprises any one or a combination of: 

a Pervasive Instance Provision Environment ("PIPE" ) to provide local or remote APIs to 
publish and optionally manage services, and optionally provide the user with user interfaces to 
publish and manage the services; 

a "Semantic Instance Scrapers for Applications" to publish available instances and to 
optionally enable the user to manage the service provisions based upon the publication; 

an "Instance Selector with Instance Providing Service Creation" to enable the user 
publish an instance the user selects for the instance selector service and optionally lets the user 
manage the service provisions; 

a publisher ("White hole") to publish objects as semantic instances through its user 
interface and optionally lets the user manage the service provisions; 

a "Public Directory" to publish instances on a device and optionally lets the user manage 
the service provisions; 

a "Bank" to publish instances through its service invocation and optionally lets the user 
manage the service provisions; 

an "Image/Audio/Video Service Control" to publish instances created by or from the 
devices and optionally lets the user manage the service provisions; 

a "Removable Media Publisher" to publish instances on the removable media inserted 
into a computing device and optionally lets the user manage the service provisions; and 

a "Fax" to publish the documents received and optionally lets the user manage the 
service provisions. 

54. (currently amended) A computer implemented method comprising: 
using a computer enabling a user to compose a task that comprises a plurality of 

different types of computing sources of functionality, each computing source of functionality 

being a service to the user, by: 

associating each service with a semantic service description (SSD), which semantically 

describes the plurality of different types of computing sources of functionality for filtering, 

composing and executing the service, and is discoverable as an available service according to 

one or more discovery protocols, wherein the SSD comprises: 

a semantic description of the service, including a semantic description of 

input/output parameters of the service as semantic input/output parameters, based upon an 

ontology, 



12 



Serial No. 10/733,328 

a filter parameter specifying relevance of the service, and 

a grounding including: 

a service invocation interface to the service; and/or 
an input/output parameter mapping and/or an input/output parameter 



transformation function between the semantic input/output parameters and syntactic input/output 
interface parameters of the service; 

dynamically discovering one or more of the SSDs as the available services through the 
p l ura li ty of one or more discovery protocols to discover the SSDs; 

interfacing with the user for real-time composing a na composed executable task 



dynamically presenting to the user feasible possible executable tasks based upon on e or mor e 
ef-filtering the discovered available services according to one or more of a context of the user 
i nc l ud i nq and/or the composed executable task, the filter parameters in the SSDs, and/or the 
semantic input/output parameters in the SSDs; and 

executing a task by invoking the two or more available services that comprise the task, 
including enabling the user to interact with an invoked available service, based upon the 
grounding in the associated SSDs including the service invocation interfaces aa dand/or the 
input/output mapping and/or the transformation functions between the semantic input/output 
parameters and the syntactic input/output parameters. 

55. (previously presented) The computer-based method of claim 54, wherein the 
computing sources of functionality originate in devices, computing applications, electronic 
services available and/or previously defined tasks. 

56. (previously presented) The computer-based method of claim 54, wherein the 
SSD is expressed in a service description language. 

57. (previously presented) The computer-based method of claim 54 wherein: 

each SSD is provided by any combination of a creator or owner of the computing sources 
of functionality or some other third party, and 

making available or unavailable the service by making available or unavailable discovery 
of one or more of SSDs associated with the service. 




i that is a combination of two or more of the available services by 
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58. (cancelled) 

59. (currently amended) The computer-based method of claim 54, further comprising 
saving the-composed executable tasks automatically, or as instructed by the user, as new 
available services. 

60. (currently amended) The computer-based method of claim 59, further comprising 
making available the saved pr e v i ous l y composed executable tasks to the user who created 
them, to all other users, or to any user-defined, or pre-defined group of users. 

61 . (previously presented) The computer-based method of claim 54, wherein the one 
or more discovery protocols include any one or any combination of the following: 

UPnP discovery, UDDI, Local Service Repository, Jini, Bluetooth SDP, Rendezvous, and 
InfraRed (IR) discovery. 

62. (previously presented) The computer-based method of claim 54, wherein the 
filtering of the discovered available services according to a context of the user include any one 
or any combination of the following: 

User profile, Task at hand, User device characteristics, User location, User motion status, 
User network connectivity, User specified keywords, features of a set of the available services 
when considered as a whole, or individual available service features. 

63. (previously presented) The computer-based method of claim 54, wherein the 
real-time composing by the user of the executable task includes any one or any combination of 
the following: 

a planning-based, automated system, or 

an interactive user interface that supports any one or any combination of the following 
elements: visual, voice, text, Braille, tactile. 

64. (previously presented) The computer-based method of claim 54, wherein the 
SSD service invocation interface is according to one or more of a remote procedure call 
including Web Services, SOAP, UPnP actions, JINI, CORBA, RMI, RPC, DCE, DCOM, KQML, 
FIPA-ACL, or InfraRed (IR), or local function call, or local object call, or code described directly in 
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the SSD. 



65. (previously presented) The computer-based method of claim 64, further 
comprising managing a computing source of functionality as an available service through the 
associated SSD by any one or any combination of the following: a graphical user interface 
controlling creation, provision, holding and/or removal of the associated SSD, executing or 
interacting with the computing source of functionality, or processing events from an operating 
system of a user-operated device, and applications executing on the user-operated device. 

66. (currently amended) A computer-readable medium storing a program which when 
executed by a computer causes the computer to execute the functions comprising: 

using a computer enabling a user to compose a task that comprises a plurality of 
different types of computing sources of functionality, each computing source of functionality 
being a service to the user, by: 

associating each service with a semantic service description (SSD), which semantically 
describes the plurality of different types of computing sources of functionality for filtering, 
composing and executing the service, and is discoverable as an available service according to 
one or more discovery protocols, wherein the SSD comprises: 



input/output parameters of the service as semantic input/output parameters, based upon an 
ontology, 



transformation function between the semantic input/output parameters and syntactic input/output 
interface parameters of the service; 

dynamically discovering one or more of the SSDs as the available services through the 
p l ura li ty of one or more discovery protocols to discover the SSDs; 

interfacing with the user for real-time composing an a composed executable task 



dynamically presenting to the user feasible possible executable tasks based upon on e or mor e 
^filtering the discovered available services according to one or more of a context of the user 



a semantic description of the service, including a semantic description of 



a filter parameter specifying relevance of the service, and 
a grounding including: 

a service invocation interface to the service; and/or 
an input/output parameter mapping and/or an input/output parameter 




i that is a combination of two or more of the available services by 
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i nc l ud i nq and/or the composed executable task, the filter parameters in the SSDs, and/or the 
semantic input/output parameters in the SSDs; and 

executing a task by invoking the two or more available services that comprise the task, 
including enabling the user to interact with an invoked available service, based upon the 
grounding in the associated SSDs including the service invocation interfaces and -and/or the 
input/output mapping and/or the transformation functions between the semantic input/output 
parameters and the syntactic input/output parameters. 

67. (previously presented) The computer-readable medium of claim 66, wherein the 
computing sources of functionality originate in devices, computing applications, electronic 
services available and/or previously defined tasks. 

68. (previously presented) The computer-readable medium of claim 66, wherein the 
SSD is expressed in a service description language. 

69. (original) The computer-readable medium of claim 66, wherein: 

each SSD is provided by any combination of a creator or owner of the computing sources 
of functionality or some other third party, and 

making available or unavailable the service by making available or unavailable discovery 
of one or more of SSDs associated with the service. 

70. (cancelled) 

71 . (currently amended) The computer-readable medium of claim 66, further 
comprising saving tbe-composed executable tasks automatically, or as instructed by the user, as 
new available services. 

72. (currently amended) The computer-readable medium of claim 71 , further 
comprising making available the saved pr e v i ous l y composed executable tasks to the user who 
created them, to all other users, or to any user-defined, or pre-defined group of users. 

73. (previously presented) The computer-readable medium of claim 66, wherein the 
one or more discovery protocols include any one or any combination of the following: 
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UPnP discovery, UDDI, Local Service Repository, Jini, Bluetooth SDP, Rendezvous, and 
InfraRed (IR) discovery. 

74. (previously presented) The computer-readable medium of claim 66, wherein the 
filtering of the discovered available services according to a context of the user include any one 
or any combination of the following: 

User profile, Task at hand, User device characteristics, User location, User motion status, 
User network connectivity, User specified keywords, features of a set of the available services 
when considered as a whole, or individual available service features. 

75. (previously presented) The computer-readable medium of claim 66, wherein the 
real-time composing by the user of the executable task includes any one or any combination of 
the following: 

a planning-based, automated system, or 

an interactive user interface that supports any one or any combination of the following 
elements: visual, voice, text, Braille, tactile. 

76. (previously presented) The computer-readable medium of claim 54, wherein the 
SSD service invocation interface is according to one or more of a remote procedure call 
including Web Services , SOAP, UPnP actions, JINI, CORBA, RMI, RPC, DCE, DCOM, KQML, 
FIPA-ACL, or InfraRed (IR), or local function call, or local object call, or code described directly in 
the SSD. 

77. (previously presented) The computer-readable medium of claim 66, further 
comprising managing a computing source of functionality as an available service through the 
associated SSD by any one or any combination of the following: a graphical user interface 
controlling creation, provision, holding and/or removal of the associated SSD, executing or 
interacting with the computing source of functionality, or processing events from an operating 
system of a user-operated device, and applications executing on the user-operated device. 
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